Papers with structured decoders
Chaining Simultaneous Thoughts for Numerical Reasoning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Numerical reasoning over text is an essential skill for AI systems . structure modeling is effective, but structures restrict how a model should grasp the reasoning process . |
| Approach: | They propose a numerical reasoner that models reasoning steps using a directed acyclic graph without pre-defined decoding dependencies. |
| Outcome: | The proposed model produces diverse reasoning steps without pre-defined dependencies and compares relevant ones to reach a solution. |
Compositional Generalization for Neural Semantic Parsing via Span-level Supervised Attention (2021.naacl-main)
Copied to clipboard
Pengcheng Yin, Hao Fang, Graham Neubig, Adam Pauls, Emmanouil Antonios Platanios, Yu Su, Sam Thomson, Jacob Andreas
| Challenge: | Existing approaches to compositional generalization in semantic parsers focus on word-level alignments, but they focus on spans. |
| Approach: | They propose a span-level supervised attention loss that improves compositional generalization in semantic parsers by focusing on spans. |
| Outcome: | The proposed method improves on three benchmarks of compositional generalization. |